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(57) Abstract: Dynamic allocaiion of network resource through the use of a measurement-based estimator is described. Measure- 
ments of bandwidth utilisation allow a measurement-based estimator to compute the bandwidth rcquiremcnts of the measured traffic. 
The use of such an estimator allows piDvision of differentiated services by adjusting the service-weighting of a queue scheduler and 
modify the depth and behaviour of buffering. By providing a dynamic allocation of rcsource,.lhe technique makes possible the dif- 
ferentiation of diverse iralUc types with a reduction in the complexity and waste of current techniques such as static-allocation or the 
best-elTort service common in ihc Internet. A novel approach is described to problems arising from the desire to offer diverse and 
sometimes orthogonal seryice facilities to a wide variety of Irafllc types. 
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METHOD AND ARnANGEMEm FOR DYNAMIC ALLOCATION OF NETWORK RESOURCES 



This invention relates to an apparatus for providing communications network resource. 

In tlie past, networks - in particular those used to support the Internet - would share 
resources: the buffers of the routers and the line capacity of the cormections between 
routers and hosts, between all network users. In the modem network it is desirable to 
divide the resource between different network traffic types. Rather than the shared 
service of die common Internet, network provide© wish to divide the resource between 
the traffic types based on other characteristics such as their willingness to pay for 
service, their need for differing service quality or some combination of the two. 

Network-elements (routers and switdies) that employ resource partitioning, such as the 
division of link bandwidth between different classes of traffic, have used a scheduler 
diat fixed, as part of its algorithm, the amount of the resource (outgoing bandwidth) to 
be allocated to each class. 

As a result, traffic queued in network routers that was not serviced could be either 
delayed or lost as the queue filled and overflowed. In such a scheme the resources of 
buffer-space and the service-weights of the sdieduler were allocated according to policy 
e.g. based on a simple priority scheme or with an assigned weightmg based on the value 
of each traffic class. 
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Past interest in traffic characterisation has noted the difficulties inherent in this 
approach. These schemes are difficult both to configure initially and to keep correct 
under changmg network demand - as a result such schemes waste resource and are 
limited in the complexity of services offered. 

The present mvention proposes the use of a Measurement-Based Estimator (MBE) of 
bandwidth requirements to enhance the performance of resource scheduling. An 
advantage of this approach is that it may be retro-fitted to current network-elements 
without significant drawback. Dynamic allocation could be added to any network- 
element as needs dictated. In such a per-network-element a^jproach, the MBE is used to 
compute the precise resource weighting of the demand of each traffic type. This 
estimate is then used to adjust the weights of scheduUng algorithms as weU as adjust the 
depth and behaviour of buffering. 

Building upon the substantia work that has been invested ui Measurement-based 
Admission Control (N4BAC), an MBAC Algorithm is adapted to continuously provide 
measurement-based estimations of bandwidth requirements and a dynamic resource 
allocator is built upon this MBE. 

A block diagram of a system in accordance with the invention is given m Figure 1. The 
dynamic aUocation system consists of a method for computing tiie demand of each 
traffic class. In the implementation presented here, the Measurement-Based Estimator 
computes the demand of each class using measurements of line utilisation, tiiese 
estimates of demand are tiien provided to the dynamic resource allocator. The dynamic 
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wei: 



allocator is able to configure the weights of a scheduler, (e.g. the weights of a 
ghted-round-robin scheduler), and the maximum buffer depth that a particular traffic 
dass may use. The network-element will impose tiiese configured restrictions upon the 
dasses of traffic as they are multiplexed onto the outgoing link. 

Differentiated services may simply be defined as he abUity of a network to offer two or 
more types of network behaviour to the network users. Examples of such networks 
include a network offering low-latency or a network that Sers low-loss. TTie combined 
approach of admission control and an appropriate scheduling algorithm has long been 
considered central to supplying Quality-of-Service (QoS) in an integrated services 
network . However, admission control is not generaUy considered practical in networks 
sudi as the modem Internet Attempts at introdudng Admission Control techniques 
(e.g. IntServ/ RSVP) are considered largely impractical to implement on a wide scale. 

Networks wishing to provide QoS but without explicit admission control are a central 
idea of the approach of the difierentiated-services network ardiitecture, DifBerv. Flows 
carried in a differentiated services system such as DiffServ do not receive an individual 
guarantee of resources. Instead, a guarantee is made to the class of traffic to whidi each 
flow belongs. The class of traffic wiU receive all the resources it requires but individual 
flow properties and flow interaction will mean that the per-flow resourcing wiU be only 
statistical in nature. This means that at any instant one particular flow may receive 
greater or fewer resources than it requires. 
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The following concentrates upon a single network-element, e.g. a core router, carrying 
several, pre-classified, classes of traffic. Two particular types of service differentiation 
are used as examples and these two schemes are now explained in detail. 

In the Olympic Service implemented using Assured Forwarding, there exists three 
classes: bronze, sUver, and gold. Traffic in each of these three classes is configured so 
that the gold class experiences lighter load than the sUver and the silver experiences 
lighter load than the bronze. While for bandwidth allocation a simple implementation 
may assign a fixed quantity of resource to each class, perhaps 50% to Gold, 30% to 
sUver and 20% to bronze. Such a fixed allocation will neglect the actual requirements of 
each traffic class. 

The benefit of the dynamic allocation scheme of tiie present invention is that it is able to 
ensure Gold demands are met in priority to SUver demands and in-tura meeting SUver 
demands while the remainder service is given to Bronze. Yet such a scheme adapts to 
tiie current requirements of each dass. Thus if SUver is not using its total aUocation, tins 
left-over is made avaUable to Bronze. Sudi a scheme pennits minimal waste of resource 
whUe allowing tiie construction of new services such as a "best efforf ' (BE) class tiiat 
receives resource only when the higher priority gold, sUver and bronze dasses have 
received their required allocations. 

In contrast to a set of classes each having a different levd of requirement in tfie same 
resource-type, an alternative set of offerings may be tiie combination of traffic dasses, 
each with differing requirements of different resources. An example of such orthogonal 
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combinations of service would be a low-loss service and a low-delay (or low delay- 
variation) service. This pair of traffic classes is a combination of the assured and 
expedited forwarding classes of DiffServ. 

The use of a programmable, dynamic network-element able to adapt to the changing 
requirements of network traffic allows considerable scope for a sophisticated policy 
allocating the available resources to traffic requurements. Two examples of broad 
allocation policy are the Olympic and orthogonal service. However a policy must be 
more complete. 

The resolution procedure when network resources are over (or under) allocated must be 
specified in the allocation policy. One example of such a resolution procedure would be 
through the use of a priority mechanism. In such a scheme, the top priority traffic class 
must be satisfied completely and then the next highest priority and so on. In the 
Olympic service differentiation it is clear that Gold will take precedence over all below 
it. Silver will take precedence over all but Gold, and so on. As an altemative to priority 
ordering, a second example for under-resourcing would be to diminish the actual 
resource to all classes of traffic, thus the drawback of under-resourcing is shared 
proportionally among the competing classes. 

In the case of over-resourcing, where more resource is available than required, the 
solution adopted may be to share the excess bandwiddi evenly among die different 
traffic classes. An altemative approach for over-resourcing may be to allocate the 
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excess resource to a best effort class of traffic, one that would only receive resource 
when all other classes had received their allocation. 

Clearly, ample opportunity exists for complex reconciliation behaviour. For the 
examples described later, the recondliation behaviour is priority based for both the 
Olympic and orthogonal differentiated service examples. In this way, the best effort 
service in each example is provided with service only after die commitment of resource 
to aU other classes of traffic has been made. The priority ordering for the Olympic 
service is Gold, SUver, Bronze and then best effort, whUe the priority ordering for the 
orthogonal differentiated service example is delay-constramed traffic, loss-constrained 
and finally the elastic traffic (using a best effort mechanism). 

The approach is tiiat a network-element will use a combination of scheduler and control 
to offer differentiated services. Several assumptions are made witfi regard to the traffic 
that impact how particular traffic types will be supplied resource by tfie network- 
element 

In particular, a first assumption is tiiat for delay-sensitive network traffic, packets 
delayed beyond the traffic's delay boundary are of no value. This implies that delay- 
sensitive network traffic is best-served by a combination of buffer discard tiueshold 
dictated by that delay-boundary and a non-wotkconserving scheduling algorithm. In 
contrast, network traffic tiiat is bounded by loss would be buffered to a deptii tiiat did 
not void any delay constraints vMe being served at a rate tiiat satisfied flie loss 
constraints. Traffic that is tiiroughput guaranteed is considered tiie most tiivial traffic 
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type requiring only limited buffering and a fixed buffer service rate. Finally, best-effort 
traffic may make use of the remaining buffer and service bandwidth providing a left- 
over service; in this way the best-effort may obtain potentially all network resource but 
without causing starvation of any resource to which a guarantee has been made. 



A key property to allow for the several different classes of this type is a packet 
scheduler with sufficient flexibility as to be able to bound the delay any particular 
session incurs in addition to simply dividing up the bandwidth resource. The ideal 
scheduler is one able to emulate Generalised Processor Sharing (GPS) scheduling - one 
able to (infinitely) divide up resource service between different traffic classes; thereby 
bounding delay while providing flexible service offerings. The GPS algorithm is not 
easily implemented in practice however a close emulation of GPS is available to packet 
networks that use a fixed cell length. 

The test-environment is based upon an ATM network. ATM networks use a fixed 
packet length, so the use of the GPS emulating algorithm is allowed. A suitable GPS 
emulating algorithm is Worst-case Weighted Fair Queueing Plus (WF^Q+), proposed in 
"An experimental configuration for the evaluation of CAC algorithms", A. Moore, S. 
Crosby, Performance Evaluation Review 27 (3) (1999) 43-54), The WF^Q+ scheduler is 
implemented in the network-element of the test-environment providing an environment 
within which the dynamic allocator can be constructed. 

A scheduler will allow a network node to allocate link bandwidth to each session. 
However, for services such as voice, which is delay sensitive, bandwidth control is not 
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enough. As noted above, flexible buffer control can improve the loss-rate of both packet 
and burst multiplexing. Therefore, buffer management provides the controls over loss 
while also controlling packet delay. 

Control over the buffer capacity available to each traffic class is required if the 
implementation is to provide resources for loss or delay constramt as well as Unk 
bandwidth. 

For delay-bound sessions, packets that exceed a buffer threshold are discarded but for 
loss-bound or throughput-guaranteed services the arriving packets are marked as 
eUgible to be discarded if no further capacity remains in the total buffer pool shared 
among sessions. In this way the work-conserving scheduler is able to consume resource 
that would otherwise be unused. 

According to the invention, there is provided an apparatus for providing 
communications network resource to a plurality of classes of use of the network, a 
different level of service being associated with each said class of use, said apparatus 
comprising: a demand estimator for estimating the demand for each of said plurality of 
classes of use; a dynamic resource allocator for allocating to each dass a proportion of 
said communications network resource, the proportion allocated being dependent on the 
estimated demand for each dass, the aUocatioii optimising use of the available resource 
whilst at the same time ensuring that the levd of service of each dass is observed; and a 
communibations network element for providing to each class the proportion of network 
resource allocated to it 
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Preferably, said communications network resource comprises bandwidth of a 
communications channel fed by said network element and/or buffer depth in said 
network element. 

Neither the scheduler or buffer technology per se is new, the novelty resides in the 
configuration of scheduler weights and buffer capacity and behaviour in combination 
with an MBE. 

An ideal MBE would allow three critical resource computations: firsdy, a computation 
of die capacity required to maintain a given delay-bound with a given probability; 
secondly, a computation of tiie capacity required to maintain a loss-rate, given a 
particular buffer size; and lastiy, die buffer size required to maintain a loss-rate for a 
given rate of service, which would be required for a service witii throughput guarantee. 
Finally, the estimator must be adaptive to changes in traffic and flexible to dianges in 
the traffic classes. 

An estimator is proposed in "Entiwpy of ATM traffic streams", N. G. Duffield, J. T. 
Lewis, N. O'ConneU, R. Russell, F. Toomey, IEEE Journal on Selected Areas in 
Communications 13 (6) (1995) 981-990. Estimators such as tiiose proposed initially 
seem ideal for the task because tfiey are able to combine a series of measurements with 
any two of die input parameters of buffer size, loss rate, or effective bandwidtfi and 
con^)ute an estimate of &e tiiird parameter. However, the type of estimator depends 
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critically upon a traffic-dependent tuning value and no robust mechanism currently 
exists for computing this value. 

Simpler measurement-based estimators are proposed in "Measurement-based 
comiection admission control", R. J. Gibbens, R P. KeUy, in: Proceedings of 15th 
International Teletraffic Congress (ITC15), 1997 or in "Comparison of measurement- 
based admission control algorithms for controUed-load service", S. Jamin, S. J. Shenker, 
P. B. Danzig, in: Proceedings of IEEE INFOCOM'97, Kobe, Japan, 1997. These or any 
estimator based upon a bufferless model of the network requires the computation of a 
compUcated surface relating the desired outcome to the tuning parameter for each 
traffictype. Additionally, this surface would need to exist in multiple dimensions in 
order to account for changes in each of link bandwidth, loss rate and queue size. 

To allow ease-of-use, die MBE of tiie dynamic allocator must offer some relationship 
between calibrated controls(e.g. servicerate, loss-rate and buffer-size) and the traffic 
behaviour to be of use. Of equal unportance is tiiat the MBE must allow for tiie 
statistical nature of the measurement while being implementable with realistic demands 
on memory and processing as well as realistic demands on tiie measurements 
themselves. The present inventor realised that tiie traffic envelope algoritiim of Knighfly 
and Qiu could be adapted to result m improved resource aUocation. This algorithm is 
described in "Measurement-based admission conttol witii aggregate traffic envelopes", 
E. W. Knightiy, J. Qiu, in: Proceedings of lOtii Tyrrhenian International Workshop on 
Digital Communications, Ischia, Italy, 1998 and «QoS control via robust envelope- 
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based MBAC, J. Qiu, E. W. Knightly, in: Proceedings of 7th ffiEE/IFIP Workshop on 
Quality of Service IWQoS, Napa, CA, 1998. 

Proposed originally by Qui and Knightly as an admission control algorithm, the present 
inventor has extracted the estimation component from the admission control framework. 
A precis of the original algorithm is given below. 

The traffic envelope approach embraces the central issue that to characterise the rate of 
a particular traffic flow a period must be specified over which that characterisation is 
conducted. As a result this MBE, is able to characterise traffic over a series of time 
periods. The intention of this multi-period characterisation is to represent the short-term 
burstiness of traffic as well as that of the longer-term variation of the aggregate due to 
measurement error and longer time-scale fluctuations. 

Firstly it is assumed that there exists a basic measurement period, r - possibly imposed 
by physical measurement limitations. Measurements may be taken over a multiple of 
this period and tiius I^^^^ ^12,...Jxt. Thus, if the traffic activity on a link over tiie 

interval [5,5+/*] is represented as X[s,s+Ik] then — L^- is the rate over that 

particular period. [10] noted that the peak rate over any interval of length can be 
given by i?^ = max,2r[j,5+/fc]. This allows the specification of the maximal rate 
envelope: a set of rates if^ that represent the maximum rate of the flow for each of the 
intervals 1^^ . 
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The activity in time slot t is represented as x, such that x, = x[n,(t +l)r]. This aUows 
a definition of the maximal rate envelope for the past T time slots from the current time 
t as 



1 ' (1) 

= -i- max 2 ^« 



for ^' = l,2,....^. The envelope /i^,^ = 1....,T describes the aggregate maximal rate 
envelope over intervals of length /, =fcrin the most recent T rseconds. [10] assert 
that this will describe short time-scale burstiness along with autocorrelation stmcture 
present in the flow. 

If every T • r periods the current envelope is updated K - Rf' ior k - lA-.r and 
„ = 2,...,Ar, then a new envelope Rl is computed using Equation 1. Uns allows the 
empirical mean R, of the K ^ to be computed as Zl, f - . In turn this allows the 
variance between envelopes for the past M windows of time T r to be computed 
using 



(2) 



Taking the mean and variance of M consecutive traffic envelopes aUows die variabiUty 
of die traffic envelope itself to be characterised at longer time-scales. 



BNSDC«ID:<WO 030841S2A1 I > 



WO03/«»«4l52 



13 



PCT/CB03/0I372 



From the traffic envelope, this MBE approach computes two estimates of effective 
bandwidth E , one for each of the two time-scales: short-term burstiness and long-term 
variance. For the long-term time-scale resulting from variance between traffic 
envelopes, the mean and standard deviation of the maximal traffic envelopes (those 
measured over Tr) provide one estimate of the effective bandwidth. 

The value of a^^ will determine how the estimator behaves in response to variability 
in the measured flow. It is possible to formulate to dictate a spedfic confidence 
interval for these constraints. Qui and Knightly considered a large variety of 
distributions on which to base ~ settling upon a Gumbel distribution for its ability 
to describe the asymptotes of the extremes for a large range of other distributions (e.g. 
Gaussian, exponential, log-normal. Gamma, Raleigh). However other work indicates 
that a Gaussian distribution is adequate, as well as allowing a more tractable 
computation. Thus in each case the computation of is based upon computing the 

inverse of a complementary CDF of an N(0,1) Gaussian distribution (Q'^O) based 
upon the maximum packet loss {s) and the traffic envelope: 
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For the shorter burstiness time-scale, a different estimator is used. The effective 
bandwidth requirement of the burst time-scale relates to the size of the buffer, q . The 
estimate of effective bandwidth requirement is computed firom the maximum of the 
traffic envelope mean and standard deviation. In the following equation, C - the 
capacity of the Unk - is required to compute the rate at which the buffer can be drained: 

£^„„3,{^>^..a£iH:}. (5) 

" c 

Unlike E^, is computed using every value of in the traffic envelope. Once 
again, the standard deviation pre-multiplier will determine the response to vaiiabUity in 
the measured flow. The derivation of from the user supplied packet-loss, e, and 
traffic envelope is 



The maximum of the two equations 3 and 5 can be considered the worst-case effective 
bandwidth estimate of the traffic flow described by the traffic envelope. This is given by 



(7) 

£ = max{£u^£d^}. 



Qui and Knightiy note tiie importance of the value of T , tiie maximum number of 
samples for a traffic envelope. An ideal value of T wiU provide the optimum use of 
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resources, while too small a value of T causes the variation over (Xj. to be large, so that 
the capacity-based estimate of Equation 3 will be pessimistic. Alternatively, if T is too 
big the estimate derived for buffer occupancy will be too large causing the buffer based 
estimate. Equation 5, to be pessimistic. In Qui and Knighdy's papers, a discussion is 
given over to locating the opdmum value of I , a value typically on the order of a few 
seconds. 

By usmg the abUity to nominate queue size and overflow probabUity, service allocations 
can be computed for certam queue, sizes. The boundary on the delay experienced 
through the buffermg of any packet in a flow may be considered as the transmission 
time per packet multiplied by the capacity of the queue. As a result the abiUty to 
compute maximum buffer sizes from delay constraints allows the computation of 
service allocations treating the overflow probability as the same probabUity that packets 
will be delayed beyond tbe delay-bound. 

In one arrangement, the scheduler implements a guaranteed fair-service queueing 
algorithm to bound queuemg delays. The WF'Q+ suppUes a weighted service for 
queued traffic with weights corresponding to the amount of service (Unk bandwidth) 
each aggtegate-flow of traffic may use. The fadlities of this schedulmg algorithm mean 
that, for the implementation, no regard need be given to the potential delay of large 
weight values. AdditionaUy. because the scheduler is work conservmg for traffic that is 
not delay bound, there is no wasted resource: the scheduler will where appropriate 
reallocate any unused resource among queues wifli packets requiring service. 
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Traffic flowing through the network-element is measured as inputs for an MBE. Using 
allocation-policy nominated control parameters, either target loss-ratio or delay-bounds, 
the MBE computes resource requirements for each class of traffic. The available 
resource is then divided up, using a weighted value derived from these estimates, and 
each appropriate weighted value is then installed into the network-element's scheduler. 
This process is continuously repeated, updating the weights of the WF^Q+ values 
dynamically, as the traffic characteristics change. 

In addition to allocating scheduler resource, it is possible to compute a queue size for a 
given loss rate and link capacity combination, as would be the case for a traffic-class 
witii a guaranteed throughput. The computation of the capacity is given as 



where a, is given in Equation 4. WhUe an estimate of the queue size q is given by: 



max {kT{Rt + a^cr^ -Q} - 4 , 



where Equation 6 defines the value of a^. For this implementation, previous 
experience with active buffer management in partiaUy-shared buffers indicated tiiat to 
ensure that tiiere is an adequate differentiation between traffic, such systems are 
sensitive to the load of each traffic type in die buffer and to the actual threshold value 
used. 
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As a result, the approach taken here is different. The buffer sizing is not used as a 
principal mechanism to differentiate one session from another. Instead, buffer sizing is 
used principally as an upper-bound on the delay properties of traffic where appropriate. 
If traffic is delay sensitive then traffic delayed by more>than a nominated amount has no 
value and that traffic exceeding this delay ought to be discarded. In contrast, the traffic 
may not be discarded if it exceeds the buffer thresholding values for flows that do not 
have an explicit delay constraint. This approach makes available transmission capacity 
that would have otherwise been wasted on traffic that was outside its delay constraint. 

This scheme may be thought of as a form of work-conservation for the flows that have 
no delay-constraint but non-work-conservation for flows that do have a delay- 
constraint. The link-capacity that may be wasted on the delay constrained traffic with 
packets now too delayed to be of use are used by the traffic that has no such delay- 
constraint. 

The test-environment consists of a combination of hardware and software. The 
hardware consists of the network-element (switch) and network interface cards. The 
software was written to obtain measurements from the network element, compute new 
configurations of flow-weights and buffer depths, generate network traffic and control 
the generation of traffic sources. Figure 2 shows the implementation architecture 
adopted to evaluate the dynamic allocator sdheme. 

Figure 2 illustrates that die MBE passes estimates to the dynamic allocator, based upon 
measurements of current utilisation. The allocator regularly recomputes and updates the 
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configuration of the network-element installing the latest configuration for scheduler 
weights and buffer limits. 

In this test environment, it is possible to start flows of traffic originating from model 
sources, video stream sources, pre-recorded traffic flows and actual elastic ti:affic such 
as TCP/IP. Such flows are initiated and terminated without any direct interaction witii 
the dynamic allocator. 

The test environment is based upon a Fore Systems ASX-200WG ATM switch as its 
network-element. The traffic generators are based upon Unix workstations (for TCP 
traffic), network-based video cameras and generators capable of creating syntiietic 
workload. Computation of the estimates, as weU as control of the test environment, is 
perfonned by task-dedicated Unix computers. Interaction witii die network-element is 
done through a devolved control architecture based upon work described in "The 
Tempest, a Framework for Safe, Resource Assured, Programmable Networks", S. 
Rooney, J. E. van der Merwe, S. Crosby, 1. LesUe IEEE Communications Magazine 36 
(10) (1998) 42-53, using extensions to tiie Pytiion prognunming language. The 
components of die test environment are described more fully in "An experimental 
configuration for the evaluation of CAC algoritiuns", A. Moore, S. Crosby,Performance 
Evaluation Review27 (3) (1999) 43-54. 

Drawn from die two examples of DiffServ given previously, two configurations are 
used to illustrate the behaviour of die MBE-based dynamic aUocator. The first 
configuration is based upon Olympic differentiated service using tiiree classes each 
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receiving a proportion of the available link capacity. The second configuration is based 
upon absolute differentiated service where three different classes (one delay-bound, one 
loss-bound and one Best-Effort) share available resource. 

The precise configuration of the policy is given alongside each set of results. The 
network is a dumbbeU configuration with a smgle constriction pomt at the network- 
element. The luik capacity is configured for 100 Mbps. 

The results mcluded in this section illustrate that the dynamic allocator is able to 
provide a number of differentiated services across a range of guarantees without the 
need for static aUocation poUcy. This system is able to use the resources of Imk-capacity 
and buffer-space to provide service to aU competmg quaUty assurances with reduced 
resource waste. Importandy, this system performs better dian best-effort by supplying 
differentiation. The implementation performs better than fixed resource poUcy by 
adapting to changing requirements and, by adapting to changing demands, dynamic 
allocation does not waste resources m the manner that fixed resourcing poUcy does. 

Two distinct experiments are reported here, firsfly the operation of an allocator with 
four classes of traffic as part of an Olympic service. The three Olympic services (Gold, 
SUver & Bronze) and a best-effort each receive a simple priority based allocation 
scheme. 

In contrast, results are then presented for a set of experiments that provide quantitative 
assessment of the perfonnance of the dynamic allocation mechanism, for a group of 
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traffic classes with orthogonal requirements. Using a combination of low-latency voice 
traffic, low-loss video traffic and a best-effort class for web traffic, the flexibility and 
successful operation of the dynamic allocator is demonstrated. 

In this section, figures illustrating the operation of the dynamic allocator are shown. The 
policy used is the Olympic service detailed previously. 

The dynamic allocator in operation is Ulustrated in Figure 3. The top graph Figure 3a 
shows the current resource demand of the three provisioned services. The middle graph 
Figure 3b shows the allocation of the scheduler to each traffic class. Each vertical line, 
representing the allocation in any particular allocation period, is divided into up to four 
segments. Each segment represents the allocation of bandwidth to one traffic class. The 
throughput experienced by eadi traffic class is plotted in Figure 3c. 

From Figure 3 it is clear tfiat at 200 seconds, an mcrease in the requirements for the 
Gold service have (virtually) eliminated any resource for a best-effort service. At the 
300 second mark, tiie resource requirements of the SUver class have increased resulting 
in flie Bronze service being paialised. Following a restoration in requirements of both 
Gold and Silver services to their former levels, service capacity is automatically made 
available to the Bronze service and remainder is available for the fourth, best-effort, 
service. It is quite apparmt that any commitments made to the Bronze service were not 
sustained between 300 and 400 seconds, although such drop-outs in service may be part 
of the Service Level Agreement made between the network-provider and network-users. 
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Many alternatives in policy are possible. In this example strict allocation priority is 
maintained. Another network-provider may implement a restriction on the impact each 
service may have upon another. Because the allocation system is programmable, as 
indicated in Section 2.3, the process may incorporate any procedure the poUcy dictates. 

As is illustrated by this example the scheme operates as required. The next section 
details the performance gained for experhnents run over longer periods of time. These 
results, made witii a system offering orthogonal services, are compared witii tiie 
performance gained using" non-dynamic allocation such as best-effort and fixed- 
allocation resourdng. 

In a second experiment tiie dynamic aUocator is configured with tiiree classes of traffic. 
These classes include ttaffic that is delay-bound and loss-bomid along witii a best-effort 
class intended to use the remaining avaUable capacity. The dynamic aUocator was 
configured to reassess tiie current allocation every 100 ms. The configuration of tiie 
estimator had measurements made every 13 ms, witfi tiie MBE configured so tiat tiie 
measurements covered a period suffidenfly large to sample beyond tiie reaUocation 
period, (for tiie MBE of tins algoritimi, x = 1.3 ms, T « 200, and M = 4), tiieiefore 
providing maximum protection from ttaffic fluctuations between consecutive 
aUocations. The values were selected to place practical demands on memory, CPU and 
measurement systems. It is expected that tiiese values would have a traffic-related 
optimum however, it was critical to illusttate ttiat values dictated by ttie implementation 
environment could provide adequate results. 
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Table 1 lists each traffic class. Alongside the characteristics of each traffic class are 
listed the policy characteristics. 

A combination of a low-delay voice aggregate, with a high-demand video aggregate, 
consumes the majority of the avaUable capacity. TTie voice traffic operates as a 
continual flow arrival and departure process affording the test traffic the full dynamics 
of a multiplex of voice data flow characteristics. Each voice traffic flow, VP64S23, 
represents a silence-suppressed voice channel with a 64kbps peak, 23kbps mean and a 
mean-burst length of approximately 23068 octets or about 60 packets (1325 octets in 
length). These values are derived from ON and OFF times of 352 ms and 650 ms from 
"A model for generating ON-OFF speech patterns in two-way conversations", P. T. 
Brady, The Bell System Technical Journal 48 (9) (1969) 2445-2472. 



nie voice-traffic class carries a multiplex of VP64S23 flows. All active VP64S23 flovirs 
lultiplexed together to form the traffic aggregate carried m as the first traffic dass. 



are mil 



Traffic 


Flow parameters 


Policy 


VP64S23 


300 second mean hold time, log- 
normal distribution: 2 flows s' 
mean, exponentially distributed 


Delay sensitive 1 x 10"^ ratio for 
packets delayed by >500ns (l"" 
priority) 


VP25S4 


4 (continuous) flows 


Loss Sensitive Target loss ratio 
1x10-^(2'^^ priority) 


WPIOSI 


10 (continuous) flows 


Best-effort 



Table 1 Parameters for traffic and poUcies of long duration dynamic allocator 

experiments. 



030841 S2A1J > 



wo »J/(«4 152 PCT/GB«3/(» 1372 

23 

The video data consists of four permanent streams of VP25S4. The VP25S4 video 
traffic is based upon an MPEG encoded, non-adaptive, video stream. Each VP25S4 has 
a peak rate of 25 Mbps and a sustained rate of 4 Mbps. Starting at random 
(uncorrelated) locations in the video-stream, the multiplex of four streams of traffic 
provides the characteristics of high-capacity, high-throughput users combined with the 
statistical effects evident both in individual traffic streams and evident in a multiplex of 
strongly structured data. 

The third traffic is WPIOSI. This traffic consisting of TCP/IP streams, represents an 
aggregate of WWW transactions, and is transmitted as the 3rd class consuming 
remaining capacity. This class is elastic, using the remaining, unused capacity and as a 
result is affected by the ongoing avaUabUity of capacity. This source has previously 
been considered a multi-stage Markov diain. 

For ttus traffic type, perfonnance of the available capacity can be measured by tiie rate 
at which bytes of data are able to be transferred between die elastic traffic's server and 
client; this performance figure is given as die goodput in tiie results of Table 2. 



Traffic 


Results 


Mean Utilisation 


Mean Allocation 


Performance 


Rest Effort ( no service differentiation^^ 


VP64S23 
VP25S4 
WPlOSl 


13.8 Mbps 
17.6 Mbps 
10.0 Mbps 




9.4 X 10 packets delayed 
2.7 X 10"^ packets lost 
4.4 Mbps goodput 


FiTTftd Service Allocation 


VP64S23 
VP25S4 
WPIOSI 


13.7 Mbps 
17.7 Mbps 
0 Mbps 


39-3 Mbps 
60.7 Mbps 
0 Mbps 


0 packets delayed 
6.5 X 10*^ packets lost 
0 Mbps goodput 


Dynamic All 


ocator 
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VP64S23 
VP25S4 
WPIOSI 


13.8 Nfbps 
17.6 Mbps 
0.8 Mbps 


27.6 Mbps 
71.2 Mbps 
1.2 Mbps 


2.2 X 10"^ packets delayed 
1.7 X 10'^ packets lost 
314 kbps goodput 



Table 2 Results of long duration dynamic allocator experiments. 



Aside from the goodput. Table 2 presents the achieved loss ratio for the video stream 
traffic and the ratio of voice packets delayed beyond the nominated delay constraint. 
This table presents results gained using best-effort, fixed allocation, and the dynamic 
allocator described as follows. The best-elEfort results were for a system that offered no 
service-differentiation between the three different classes. Clearly, the WWW traffic 
WPlOSl gained excellent goodput at the expense of the loss and delay of the video and 
audio traffic. 

The fixed service allocation results gave the voice (in this example the highest priority) 
ail the bandwidth required. The fixed bandwidth allocation was based upon the peak- 
rate requirements of the voice traffic. As VP64S23 flows start and stop, the allocated 
resource was adapted as required. An attempt was made to allocate to the video traffic a 
fixed bandwidth allocation based upon its peak-rate requirements, although tfiis was 
never able to be satisfied. The immediate result for the video traffic was that there was 
insufficient bandwidth for an allocation that would satisfy the requirements outlined in 
Table 1. Finally, with allocations made for voice and video, there was no bandwidth, 
remaining for a static allocation to the WPIOSI traffic and as a result no throughput or 
goodput was achieved. 
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Finally, the dynamic aUocator results indicate that it was able to achieve the policy 
agreements in this system. However, along with the mean allocation requirements, the 
delay/loss ratios for both the VP64S23 and VP25S4 are taken from results taken over 
long-running experiments and results measured on a smaller timescale may indicate 
lower performance. Additionally, for the dynamic allocator results, the error margin on 
the packet-delay figures as they were gathered is still quite high, at ±12% with a 95% 
confidence interval for IxlO'^ and ±5% with a 95% confidence interval for the packets- 
loss figure. Experiments for these results were run for a sufficient time to reduce the 
error due to sampling to less than ±1% with a 95% confidence interval. ITius, taking 
into account die precision of the results gained, it may be concluded that the dynamic 
allocator prototype worked successfully. 

In die prior art, network-elements have employed inflexible fixed resource partitioning 
between different classes of traffic The present invention uses Measurement-Based 
Estimation as input to a dynamic resource aUocator. Such an allocator can offer 
difBeientiated service by adjusting the service-weighting on a queue scheduler and 
controlling die optimum bufBer depth for queueing packets fiom each dass. As a result, 
tiie specification of poUcy allows for a highly flexible scheme. 

The results indicate tiiat while tiiis is not a general answer to aU differentiated service 
network problems, fliis scheme provides a novel and unique approach to offer diverse, 
and ortiiogonal services to a wide variety of traffic types. 
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Problems may still remain with over-allocation due to delay constraints. However, 
without the support of a more complex scheduling algorithm, the approach taken gave 
acceptable results. Additionally, providing the best service for elastic traffic still 
requires further work. 



In spite of the TCP-related drawbacks, the dynamic allocator is able to provide a service 
that is better than the fixed allocation approach, providing both voice and video data 
with the desired conditions of loss and delay. Additionally, by using the dynamic 
allocator in place of a fixed allocation, provision was available for a third, best-effort 
service that used the left-over bandwidth, a service not provided for at all in the fixed 
allocation approach. 
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CLAIMS 

1. An apparatus for providing communications network resource to a plurality of 
classes of use of the network, a different level of service being associated with 
each said class of use, said apparatus comprising: a demand estimator for 
estimating the demand for each of said plurality of classes of use; a dynamic 
resource allocator for allocating to each class a proportion of said 
communications network resource, the proportion allocated being dependent on 
the estimated demand for each class, the allocation optimising use of the 
available resource whilst at the same time ensuring diat the level of service of 
each class is observed; and a communications network element for providing to 
eadi dass the proportion of network resource allocated to it 

2. An apparatus according to claim 1 wherein said communications network 
resource comprises bandwidth of a communications diannel fed by said network 
element and/or buffer depth in said network element 

3. An apparatus as daimed in daim 1 or 2 wherein said demand estimator uses a 
traffic envelope scheme in whidi traffic flow is diaracterised by qwdfying a 
particular period or periods over whidi that diaracterisation is conducted. 

4. An apparatus as claimed in daim 3 wherein ihe mean and variance of 
consecutive traffic envelopes is determined to estimate effective bandwidtii 
requirements. 

5. An apparatus as daimed in claim 3 or 4 wherein a first effective bandwidth, E 
long, given by - + a^^cTj and a second effective bandwidth, E short. 
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eiven bv £^ = max (l^L±5^o!£t)^} are used to give the worst case 

"c 

effective bandwidth estimate E of the traffic flow described by the traffic 
envelope £ = max{£^£staK,}> where the terms used in the equations are 

defined in the present specification. 

6. An apparatus as daimed in any preceding claim wherein a best-effort service is 
provided as one of the classes. 

7. An apparatus as claimed in any preceding claim wherein voice and/or video data 
is transferred across the network. 

8. A method of using a Measurement Based Estimator to provide input to a 
dynamic resource allocator in a network element. 
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